Inventor: MIHAELA VAN DER SCHAAR 
Attorney Docket: US 010212 
Title: TOTALLY EMBEDDED FGS VIDEO CODING WITH MOTION COMPENSATION 
Contact: Russell Gross (914) 333-9631 



1/8 



10 



FINE GRANULAR SCALABLE ENHANCEMENT LAYER 



- L .-12 
-> R MAX 



R, 



EL 



I 


— ► 


B 




P 


— > 


B 


< — 


P 



---->> B BL 
— ► 



PREDICTION-BASED VIDEO BASE LAYER 



OVERCODED ENHANCEMENT 
PICTURE 



PORTION OF FGS ENHANCEMENT 
SENT TO THE DECODER 



FIG.1 

(PRIOR ART) 



Inventor: MIHAELA VAN DER SCHAAR 
Attorney Docket: US 010212 
Title- TOTALLY EMBEDDED FGS VIDEO CODING WITH MOTION COMPENSATION 
Contact: Russell Gross (914) 333-963 1 

2/8 



.20 



FGS 

ENHANCEMENT 
LAYER (EL) 
ENCODER 



FGS CODING: 
DCT FOLLOWED BY . 
BIT-PLANE DCT SCANNING 
AND ENTROPY CODING 




FGSR(i) 
2 H- 



EL 



STREAM 



ORIGINAL 



VIDEO 
0(i) 



■XI 



Ref(i) 



- MCR(i) 



DCT 



QUANTIZATION 
Q 



MCRQ(i) 



INVERSE 
DCT" 1 



ENTROPY 
ENCODER 



MUX 



INVERSE 
QUANTIZATION 



Q' 



-1 



r® 



BASE LAYER (BL) 
ENCODER 



MOTION 
COMPENSATION 

T — 



FRAME 
MEMORY 



MVs 



MOTION 
ESTIMATION 



FIG. 2 

(PRIOR ART) 



Inventor: MIHAELA VAN DER SCHAAR 
Attorney Docket: US 010212 
Title: TOTALLY EMBEDDED FGS VIDEO CODING WITH MOTION COMPENSATION 
Contact: Russell Gross (914) 333-963 1 



3/8 



30 



\ 



PREDICTION-BASED FINE GRANULAR SCALABLE ENHANCEMENT LAYER 



: b i 

I J 



>J A 



PREDICTION-BASED VIDEO BASE LAYER 



100 



FIG. 3A 




FIG. 3B 



Inventor: MIHAELA VAN DER SCHAAR 
Attorney Docket: US 010212 
Title- TOTALLY EMBEDDED FGS VIDEO CODING WITH MOTION COMPENSATION 
Contact: Russell Gross (914) 333-9631 

4/8 



40 



54- 



FGS CODING: 
DCT FOLLOWED BY 
BIT-PLANE DCT SCANNING 
AND ENTROPY CODING 



FGS 
ENHANCEMENT 
LAYER (EL) 
ENCODER 



ORIGINAL 45) 62 



64 



r 65 



55- 



TAKE SEVERAL 
OF THE CODED 
BIT-PLANES, E.G.M 




53 



2 H- 




MUX 



63 



L _____ _ 




47 



QUANTIZATION 
Q 



EL 



STREAM 



42 



ENTROPY 
ENCODER 









INVERSE 
QUANTIZATION 


INVERSE 
DCT" 1 


< — 




Q" 1 



MUX 



49 



■51 



*50 



■44 



MOTION 
COMPENSATION 



BASE LAYER (BL) 
ENCODER 



FRAME 
MEMORY 



MOTION 
ESTIMATION 



■60 
■43 



MVS 



BL 



STREAM i 



•41 



-> B-FRAMES 
> I/P-FRAMES 



FIG. 4 



Inventor: MIHAELA VAN DER SCHAAR 
Attorney Docket: US 010212 
Title: TOTALLY EMBEDDED FGS VIDEO CODING WITH MOTION COMPENSATION 
Contact: Russell Gross (914) 333-9631 



5/8 



■140 



54- 



FGS CODING: 
DCT FOLLOWED BY 
BIT-PLANE DOT SCANNING 
AND ENTROPY CODING 



FGS 
TEXTURE 
ENCODER 



ORIGINAL 



TAKE SEVERAL OF THE 
CODED BIT-PLANES, E.G. I 




Ref(i) 




55 



BASE LAYER (BL) 
ENCODER 



MOTION 


< 


COMPENSATION 




+ 




. FRAME 




MEMORY 








. MOTION 




* ESTIMATION 





44 



•60 



■43 



-142 



->► MUX 



OUTPUT 
► 



STREAM 



49 



MVS 



^141 



FIG. 5 



Inventor: M1HAELA VAN DER SCHAAR 
Attorney Docket: US 010212 
Title: TOTALLY EMBEDDED FGS VIDEO CODING WITH MOTION COMPENSATION 
Contact: Russell Gross (914) 333-963 1 

6/8 



70- 



ENHANCEMENT 
LAYER DECODER 

85 \ 



92 



EL 



STREAM 



i 74a i — 

^~ ' FGS 
BIT-PLANE 



DE- 
MUX 



DECODING 



4- 



86 



TAKE SEVERAL 
OF THE CODED 
BIT-PLANES, E.G.MU 



72 



84 



-74b 



BASE LAYER 
DECODER 

75a 

BL 



STREAM 

r 
73 



DE- 
MUX 




MOTION 
COMPENSATION 



BASE LAYER 




P 



75b 



BASE LAYER 
VLD 

1 



81 





-82 


80^ 


INVERSE 
QUANTIZATION 

Q- 1 






-> 


INVERSE 
DCT 









78 



83 



ENHANCED 
► VIDEO 



VIDEO 
(OPTIONAL) 



71 



* B-FRAMES 
>IOR P-FRAMES 



FIG. 6 



Inventor: MIHAELA VAN DER SCHAAR 
Attorney Docket; US 010212 
Title: TOTALLY EMBEDDED FGS VIDEO CODING WITH MOTION COMPENSATION 
Contact: Russell Gross (914) 333-9631 



7/8 



170 



CODED 

> 

STREAM 



FGS TEXTURE 
DECODER 



185 



, — | _j 



175 , i 



FGS 
BIT-PLANE 
DECODING 



186 



TAKE SEVERAL 
OF THE CODED 
BIT-PLANES, E.G.M 



184 



X 

176- 



MOTION 
COMPENSATION 



FRAME 
MEMORY 



DE- 
MUX 



_MVs_j 



^174 



177 




172 



OUTPUT 



173 



FIG. 7 



Inventor: MIHAELA VAN DER SCHAAR 
Attorney Docket: US 010212 
Title: TOTALLY EMBEDDED FGS VIDEO CODING WITH MOTION COMPENSATION 
Contact: Russell Gross (914) 333-9631 



8/8 



200 



201 
_^ 

VIDEO/ 
IMAGE 
SOURCE(S) 



203 



204 



INPUT 
VIDEO/ 
IMAGE 



PROCESSOR 



T 

205 



MEMORY 



I 206 

t 




DISPLAY 




DEVICE 



INPUT/OUTPUT 
DEVICE(S) 



202 



OUTPUT 
VIDEO/ 
IMAGE 



FIG. 8 



